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© Workstation power management 



© This invention is a power conserving method 
and apparatus for managing a computer memory. A 
first memory bank comprises normal RAM. A second 
memory bank comprises low-power RAM. More fre- 
quently used virtual pages are mapped onto the first 
memory bank while less frequently used virtual 



pages are mapped onto the second memory bank. 

Further power savings are achieved by removing 
power from the driver circuits of the memory control- 
ler for the second memory bank when the second 
memory bank is not being referenced. 
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This invention relates to an apparatus and a 
method for power conservation techniques for 
workstations according to the preamble of claims 1 
or 4 respectively. 

In order to obtain true portability in micro- 
computers and workstations, battery power is es- 
sential. Moreover, given the capacity versus size 
limitations of known batteries, it is essential to 
minimize total power consumption in order to ex- 
tend the operating life of the batteries. 

It is relatively easy to reduce battery consump- 
tion by an initial 60 to 70 percent. This initial 
savings can be accomplished by simply turning 
selected pieces of hardware off when they are not 
being used. The last 30 to 40 percent savings 
becomes increasingly more difficult to achieve, 
while simultaneously becoming increasingly more 
valuable in terms of extending battery life. This is 
due to the inverse relationship between battery life 
and battery load. Accordingly, savings that would 
seem trivial in off-line applications, might be mo- 
mentous in a battery powered environment. 

Further reduction in total power consumption 
may be achieved by replacing high power hard- 
ware with low power consuming hardware. Nor- 
mally, however, this involves a tradeoff of perfor- 
mance. For example, the power consumption of 
random access memory (RAM) is generally a func- 
tion of how fast the memory is. Very fast RAM will 
consume relatively large amounts of power, while 
slower RAM will generally use (ess power. Thus, 
while overall power consumption may be reduced 
in this manner, it is done at a sacrifice of perfor- 
mance. 

In the past, computer memories have been 
managed for efficiency whereby infrequently need- 
ed blocks of memory were collected and paged out 
to disk, while frequently used blocks were collected 
and maintained in main memory for efficient ac- 
cess. U.S. Pat. Nos. 4,660,130 and 4,758,944, both 
to Bartley et al. are exemplary of such conventional 
memory management methods. 

It is the object of the present invention to 
provide a method and apparatus for managing 
computer memory such that low power consump- 
tion is achieved without the corresponding loss of 
performance. 

The solution is described in the characterizing 
part of claim 1 or 4 respectively. 

A computer memory is divided into two mem- 
ory banks. The first memory bank comprises nor- 
mal RAM. The second memory bank comprises 
low-power RAM. The memory controller for the 
low-power memory is operable such that the driver 
circuits may be powered down independent of the 
memory controller logic. Power is removed from 



the driver circuits when the second memory bank 
is not being referenced to allow for further power 
savings in the low-power memory. 

Pages of virtual memory are then mapped onto 
s the memory banks according to their frequency of 
reference. More frequently used pages are mapped 
onto the normal memory while less frequently used 
pages are mapped onto the low-power memory, 
tt is an advantage of the present invention that 
io power consumption of a computer memory is re- 
duced without a corresponding degradation in sys- 
tem performance. 

It is another advantage that less expensive 
components may be used in a portion of the phys- 
75 ical memory of a computer without a corresponding 
degradation in system performance. 

Fig. 1 is a block diagram representing the 
structural elements of the apparatus of 
the present invention. 
20 Rg. 2 is a flow chart illustrating the memory 
reference operation of this invention. 
Fig. 3 is a flow chart illustrating the page 
placement daemon function of this in- 
vention. 

25 Rg. 4 is a flow chart illustrating the page 
swapper operation of this invention. 
Ideally, a computer would have a very large, 
very fast memory. Unfortunately, memory speed is 
inversely related to memory capacity, and the cost 

30 per bit for very fast memories is extremely high. 
These limitations dictate that most computers will 
utilize virtual memory. 

A virtual memory system uses random access 
memory, a mass storage system, and an address- 

35 mapping control device [or memory management 
unit (MMU)]. These three elements are used in 
combination to simulate one large random access 
memory. The mass storage system typically has a 
much larger capacity than the RAM, but corre- 

40 spondingly, also has a much longer access time. 

The mapping between virtual memory and 
physical memory is typically done in "pages" of 
memory. A "memory page" is a convenient collec- 
tion or aggregation of memory locations. Page 

45 sizes generally range from one kilo-byte (1 kB) to 8 
kB. A 4 kB page size is typical. 

Virtual memory functions as follows. The mem- 
ory management unit maintains a page table which 
contains an entry for each page of virtual memory 

so currently present in the system RAM. Each entry in 
the page table contains a physical address repre- 
senting the start (beginning) address of the phys- 
ical page in system RAM. The upper or more 
significant bits of the virtual and physical addresses 

55 represent a page number. 

On each memory reference by a CPU, the 
CPU presents a virtual address to the MMU. The 
MMU then searches the page table for a match to 
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the virtual page number. If the page is found in the 
page table, then the MMU takes the start address 
of that page in system RAM and adds to it the 
lower bits of the virtual address to form a complete 
physical address. This physical address is then 
placed on the memory bus and the transaction is 
completed by an appropriate memory controller. 

If the page address is not found in the page 
table, then this indicates that either the page does 
not exist or that it is currently stored on the mass 
storage system. In that case, the MMU will gen- 
erate an interrupt to the CPU. The interrupt will 
invoke the operating system's memory manager, 
which normally controls the MMU. The memory 
manager will then either create the page or cause it 
to be swapped from the mass storage system into 
the system RAM. 

Although, there are performance costs resulting 
from the need to check the page table upon each 
memory reference and from the movement of 
pages between the mass storage system and the 
system RAM, the virtual memory system will simu- 
late a system RAM with a capacity of the mass 
storage system and with an access time that on 
average will be close to that of the actual system 
RAM. In this manner, the virtual memory system 
can simulate a large system RAM but at a much 
lower cost. 

The preferred embodiment of the present in- 
vention is now described with reference to Figures 
1 - 4. A 32-bit address-word microprocessor is 
discussed, but the invention is not limited to such 
an address size and may be utilized with different 
word sizes. 

The typical microcomputer benefits from the 
concept of virtual memory. The virtual address 
space of a central processing unit (CPU) 100 is 
mapped into the physical address space of a sys- 
tem RAM 300 via the page table function of a 
memory management unit (MMU) 200 and the 
page swapping function of the operating system's 
memory manager. System RAM 300, is a fast, 
volatile RAM memory and provides the working 
storage used by CPU 100. 

Mass storage 400 may also be available to 
MMU 200. Mass storage 400 includes a direct 
access storage device (DASD) 404 and a cor- 
responding DASD controller 402. DASD 404 may 
be represented by a magnetic or an optical disk. 

System RAM 300 is divided into two memory 
banks: a low-power memory bank 310 and a nor- 
mal memory bank 320. Low-power memory bank 
310 includes a memory controller 312 and a low- 
power RAM 316. Normal memory bank 320 in- 
cludes a memory controller 322 and a normal RAM 
326. 



The RAM microcircuit chips of memories 316 
and 326 are available in convenient packages 
known as Single In-Line Memory Modules or 
SIMM. For convenience of use, SIMM's are the 

5 preferred embodiment of memories 316 and 326. 

Memory controllers 312 and 322 each contain 
both driver circuits and logic circuits. The driver 
circuits perform the reading from, and writing to, 
the RAM memory. The logic circuits are responsi- 

io ble for detecting an address reference to, and 
generating control signals and address data for, 
each corresponding physical memory location. 

Each read from or write to a page of memory 
is called a memory "reference". The number of 

rs references per unit time is the "reference frequen- 
cy". A private memory 500 is provided for storing 
memory reference information. 

Every page of virtual memory may be repre- 
sented by a page in system RAM 300 and/or, if a 

20 page hasn't been referenced for a relatively long 
period of time, in mass storage 400. The page 
table or memory map is maintained by the memory 
manager and keeps track of where each virtual 
page is physically represented. 

25 This invention is primarily concerned with re- 

ducing the power consumption of system RAM 300 
by controlling the placement of the physical pages. 
The placement is done according to the reference 
frequency for each particular virtual page. 

30 The more frequently referenced pages are 

maintained in normal memory 320 in order to 
achieve optimum performance. Normal RAM 326 of 
normal memory 320 is a high speed, high power 
RAM memory. The less frequently used pages of 

35 memory are stored in low-power memory 310. 
Low-power RAM 316 will consume less power and 
will therefore tend to be slower than normal RAM 
326. 

This optimization scheme balances the perfor- 

40 mance cost of migrating a page between the two 
memory banks with the higher power cost asso- 
ciated with leaving the page in normal memory 
320. Power savings are achieved because low- 
power RAM 316 tends to consume less power than 

45 the faster high-power RAM which is conventionally 
used throughout system RAM 300. 

Additional power can be saved in the driver 
circuits of memory controller 312. The driver cir- 
cuits of memory controllers 312 and 322 drive both 

so system bus 202 and corresponding SIMM buses 
314 and 324, respectively. These driver circuits are 
responsible for the majority of the power consumed 
by memory banks 310 and 320. Under normal 
conditions, the refresh cycle of the RAM and the 

55 logic circuits use only a nominal amount of power. 

Accordingly, to achieve yet further power sav- 
ings in low-power memory 310, it is desirable to 
switch the driver circuits of memory controller 312 
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off when they are not being used. To permit this, 
the driver circuits of memory controller 312 are 
powered independent of the logic circuits and are 
operable in two states: a first active state and a 
second standby or sleep state. 

In the first active state, the driver circuits func- 
tion normally and may satisfy a memory reference. 
In the sleep state, however, power is removed from 
the driver circuits so that they are passive rather 
than active circuit elements. In this state, the mem- 
ory controller is not capable of satisfying a memory 
reference. 

Normally, when a reference is made to a RAM 
memory, the memory controller logic circuits will 
decode the physical address received from the 
MMU and reference the actual memory cells 
through the driver circuits. If the driver circuits of 
memory controller 312 are in the sleep state when 
the CPU makes a reference to a page in low-power 
memory 310, then the memory controller 312 will 
be unable to satisfy the request because the driver 
circuits are inactive. Thus, the logic circuits must 
be able to sense that a reference has been made 
and apply power to the driver circuits. 

Accordingly, upon receipt of an address re- 
ferencing low-power memory 310, the logic circuits 
of memory controller 312 execute the memory 
reference operation shown in Fig. 2: 

(1) if the driver circuits of low-power memory 
controller 312 are powered-up, then the refer- 
ence can be satisfied in the usual way (Steps 
2002 and 2008); 

2) if the driver circuits of low-power memory 
controller 312 are not powered-up, then power is 
restored (Step 2004) and allowed to stabilize 
(Step 2006) before satisfying the reference 
(Step 2008); 

(3) a hardware timer is set to turn the power to 
the driver circuits back off after a set interval 
(Steps 2010 and 2016); and 

(4) if reference counting is enabled (Step 2012) 
then the page address is written to the private 
memory table 500 (Step 201 4). 

Performance concerns dictate that it is not 
practical to power down the driver circuits of mem- 
ory controller 322. Thus, only memory controller 
312 need have the capability of independently 
powering the driver circuits. 

Determination of whether a page belongs in 
normal memory 320 or in low-power memory 310 
is the function of a page placement daemon. The 
daemon is part of the operating system's memory 
manager. The daemon is loaded as a background 
process during system initialization and thereafter 
remains inactive until invoked by an interrupt. Upon 
receiving an interrupt, the daemon calculates the 
reference frequency for each page in low-power 
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memory 310 and then makes a decision based on 
set criteria on whether to migrate each page to 
normal memory 320. 

In order to make the determination of proper 

5 location for a page of memory, the daemon must 
have access to reference information for each page 
of memory in low-power memory 310. The pre- 
ferred way for maintaining a reference count uti- 
lizes private memory 500. 

io Private memory 500 is organized as a table for 

storing page addresses. The daemon does not 
write to this memory, but may read it and may 
reset the table pointer. When a reference is made 
to low-power RAM 316, the page address of the 

75 particular page is written to private memory 500 by 
memory controller 312 at a location indicated by 
the table pointer for the private memory. For exam- 
ple, given a 4 kB page size with 32 bit addressing, 
the private memory would be a 100 kB memory 

20 organized as a table 20 bits wide. The top (or most 
significant) 20 bits of the address identify the par- 
ticular page and would be written into the table by 
memory controller 312 as the next table entry and 
the table pointer would be incremented. Period i- 

25 cally, or when the low-power memory controller's 
private memory 500 is full, memory controller 312 
produces a specific interrupt to processor 1 00. This 
interrupt invokes the daemon. With reference to 
Figure 3, the daemon then performs the following 

30 steps: 

(1) The daemon computes the time since it was 
last invoked (Step 3002); 

(2) The daemon reads the private memory 500 
(Step 3004) and resets the table pointer (Step 

35 3006); 

(3) For each unique page identifier in the private 
memory table, the daemon computes the fre- 
quency of reference (Step 3010); 

(4) For any and all pages for which the refer- 
40 ence frequency exceeds a threshold (Step 

3012), the daemon uses the operating system's 
page table to obtain the actual page number, 
and then directs the operating system's page 
swapper to move these pages into normal mem- 
45 ory 320 (Step 3014); and 

(5) When the last page address is processed, 
the daemon exits (Step 3008). 

tf a transfer is made to normal memory 320 
and that memory is full, then a page will have to be 

so swapped out to make room for the incoming page. 
The page to be swapped out may be selected by 
any number of ad hoc rules or as a function of its 
frequency of reference. 

It is preferred to select the page of normal 

55 memory 320 to be swapped to low-power memory 
310 as a function of its reference frequency. This 
could be achieved by having memory controller 
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322 write page addresses to another private mem- 
ory, and similarly involving the daemon in the cal- 
culations. 

When a page must be moved between normal 
memory 320 and low-power memory 310, the pre- 
ferred means for making the transfer is the page 
swapper of the resident operating system. All 
page-oriented operating systems have a page 
swapper, which is part of the memory manager. 

For this invention, two modifications of the 
page swapper algorithm are required. First, when 
the memory manager finds that it must load a page 
from mass storage, such as DASD 107, into sys- 
tem RAM 300, or when it creates a new page, 
these pages must initially be loaded/created in 
normal memory 320. Second, the swapper must 
accept requests from the daemon to move pages 
from low-power memory 310 to normal memory 
320. 

When the page swapper moves a page from 
low-power memory 310 to normal memory 320, it 
wiii normally have to bump a page out of normal 
memory 320 and into low-power memory 310. As 
discussed above, it will need to choose which page 
to move out of normal memory 320. If a means 
involving a private memory and the daemon is not 
employed to classify pages of normal memory 320 
according to their frequency of reference, then the 
preferred method is for the page swapper to use 
the same steps which it employs in deciding when 
to move a page from system RAM 300 to mass 
storage. 

In making a transfer to normal memory 320 
which involves a bump of another page to low- 
power memory 310, the swapper will perform the 
steps illustrated in Fig. 4: 

(1) upon receiving a request (Step 4002), the 
swapper uses its standard algorithm to select a 
page to be moved from normal memory 320 to 
low-power memory 310 (Step 4004); 

(2) it disables reference counting in low-power 
memory controller 312 (Step 4006); 

(3) it moves the selected page from normal 
memory 320 to low-power memory 310 (Step 
4008); 

(4) it moves the designated page from low- 
power memory 310 to normal memory 320 
(Step 4010); 

(5) it enables reference counting in the low- 
power memory controller 312 (Step 4012); and 

(6) it exits. 

This strategy assumes that there is consider- 
able locality of physical address references, so that 
the performance overhead of enabling a driver 
need occur only infrequently. 

Thus, although there will be an overhead bur- 
den imposed on the processor, after an initial 
phase in the execution of an application, wherein 



most of the page movement occurs, a stable dis- 
tribution will quickly be achieved and thereafter 
there will be little overhead. 

In an alternative embodiment rather than use 

5 private memory 500, the daemon may keep track 
of references to low-power memory 310 directly in 
the operating system's page table. In this embodi- 
ment, upon sensing a reference to a page of low- 
power RAM 316, memory controller 312 would 

io produce an interrupt to the daemon. 

Upon receiving an interrupt, the daemon will 
make a decision based on set criteria on how to 
handle the memory reference. It has two options: 
first, if the daemon determines that the page is 

15 not referenced with sufficient frequency to justify 
moving that page to normal memory 320, then the 
daemon will simply turn on the driver -circuits so 
that the reference can be made and then set a 
timer which will turn the driver circuits back off 

20 after a fixed period; 

second, if the daemon determines that the 
page is referenced with sufficient frequency, then 
the daemon will turn on the driver circuits, set a 
timer which will turn the driver circuits back off 

25 after a fixed period, and either call the operating 
systems page swapper which will transfer the 
page of memory to normal memory 320, or the 
daemon may make the transfer itself. 

This alternate embodiment, however, involves 

30 numerous additional instructions and will result in 
an increased overhead burden on CPU 100 relative 
to the first embodiment. 

Although the invention has been described and 
illustrated with a certain degree of particularity, it is 

35 understood that those skilled in the art will recog- 
nize a variety of applications and appropriate modi- 
fications within the spirit of the invention and the 
scope of the claims. 

40 Claims 

1. Apparatus for managing a computer memory 
to conserve power, characterized by 

45 a computer memory (300) divided into at least 

first and second memory banks (310, 320); 

control means (312, 322) for controlling said 
second memory bank (322); 

50 

memory manager means (200) for managing 
the placement of pages of memory so that 
more frequently referenced pages are main- 
tained in said first memory bank- (31 2); 

55 

driver circuit means for writing to and reading 
from said second memory bank; 
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logic means for detecting an address reference 
to, and generating control signals and address 
data for, said second memory bank; 

means for controlling the power to said driver s 
circuit means independent of the power to said 
logic means, whereby said driver circuit means 
is operable in a first active state and a second 
unpowered state; 

70 

means for generating a signal when said logic 
means detects an address reference to said 
second memory bank; and 

means for receiving said signal and accord- 75 
ingly instructing said driver circuit means to 
switch to said first active state, whereby said 
second memory bank may be referenced. 

2. Apparatus of claim 1, characterized in that the 20 
memory manager means comprises: 

means for counting references to a specific 
page of memory in said second memory bank; 

25 

means for calculating a frequency of reference 
from reference count data maintained by said 
counting means; 

means for comparing said frequency of refer- 30 
ence to an established criterion; and 

means for moving said specific page of mem- 
ory to said first memory bank. 

35 

3. Apparatus of any one of claims 1 and 2, char- 
acterized in that said first memory bank com- 
prises first RAM, and said second memory 
bank comprises second RAM, where said sec- 
ond RAM draws less power than said first 40 
RAM. 

4. Method for managing a computer memory ac- 
cording to one of the claims 1-3, characterized 

by 45 

counting references to a first page of memory 
in said second memory bank; 

calculating the reference frequency for said so 
first page of memory; 

comparing said reference frequency to an es- 
tablished criterion; and 

56 

transferring said first page of memory into said 
first memory bank if said reference frequency 
exceeds the established criterion. 



5. Method of claim 4, characterized by 

removing power from said driver circuit section 
when said second memory is not being re- 
ferenced; and 

applying power to said driver circuit section 
when said logic circuit section receives a refer- 
ence to said second memory bank. 

6. Method of claim 5, characterized by 

counting references to a second page of mem- 
ory in said first memory bank; 

calculating the reference frequency for said 
second page of memory; and 

swapping said second page of memory out of 
said first memory bank upon transferring said 
first page of memory into said first memory 
bank. 

7. Apparatus for managing a computer memory 
to conserve power according to one of the 
claims 1-3, characterized by 

a first memory bank comprising first RAM; 

a second memory bank comprising second 
RAM which draws less power than said first 
RAM; and 

a memory manager for managing the place- 
ment of pages of memory wherein more fre- 
quently referenced pages are placed in said 
first memory bank. 

8. Apparatus of claim 7, characterized by 

a private memory for storing page addresses; 

a memory controller for said second memory 
bank, said memory controller having a logic 
circuit and a driver circuit wherein the driver 
circuit is powerable separately from the logic 
circuit, and wherein the logic circuit detects 
address references to said second memory 
bank, and thereafter, writes detected page ad- 
dresses to said private memory; 

a first signal generator for generating a first 
signal when said logic means detects an ad- 
dress reference to said corresponding second 
memory bank; 

a second signal generator for generating a 
second signal upon detecting a full private 
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memory; 

a switch for enabling power to said driver cir- 
cuit; and 

5 

a first receiver to receive said first signal and 
toggle said switch accordingly. 



dependency from the decode logic circuit 
means whereby the driver circuit means will 
normally remain in an unpowered state and the 
decode logic circuit means will generate a 
command signal to turn on power to the driver 
circuit means upon receipt of a memory refer- 
ence request. 



9. Apparatus of claim 8, characterized by 
a processor; 

a second receiver to receive said second sig- 
nal; and 

a timer; 

wherein upon receiving said second signal, 
said processor reads said page addresses 
from said private memory and establishes a 
reference count for a specific page of memory, 
said processor calculates the time elapsed 
since receipt of a previous second signal, said 
processor calculates the frequency of refer- 
ence for said specific page of memory, and 
said processor compares said frequency of 
reference to an established criterion. 



75 



20 



12. Apparatus of claim 11, characterized by 

sense circuit means for detecting a memory 
reference to said memory storage device; 

signal circuit means to generate a command 
signal instructing said drive circuit means to 
turn on upon detection of a memory reference 
by said sense circuit means; 

timer circuit means to turn off power to the 
driver circuit means after a pre-determined pe- 
riod of time. 



25 



10. Method for reducing power consumption in a 
page-oriented computer memory, character- 30 
ized by 

maintaining more frequently referenced pages 
in a first memory bank; 

35 

maintaining less frequently referenced pages 
in a second memory bank; 

controlling said second memory with a mem- 
ory controller comprising a logic part and a 40 
driver part, wherein the driver part is powera- 
ble independent from the logic part; 

switching off power to said driver circuits; and 

45 

switching on power to said driver circuits when 
said logic circuits detect a reference to said 
second memory. 

11. Apparatus for operating according to the meth- so 
od of claim 4 or 10, characterized by 

decode logic circuit means for translating 
memory address data; and 

55 

driver circuit means for performing read and 
write accesses to a memory storage device, 
said driver circuit means being powerable in- 
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